Navigation based on at least one sensor and a three dimensional map

ABSTRACT

The invention relates to a method for navigation of an aerial vehicle. The method comprises providing a sensor image from an aerial vehicle sensor. The method also comprises to repeatedly, until at least one predetermined criterion is reached, perform the step of setting input data, where the input data comprises information related to pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle, the step of providing a two-dimensional image from a database based on the input data, where the database comprises three-dimensional geo-referenced information of the environment, and the step of comparing the sensor image and the two dimensional image from the database. The method further comprises using the input data for which the two images correspond best to each other for determining at least one of the following quantities pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of and claims priority to andthe benefit of U.S. application Ser. No. 14/363,261, filed Jun. 5, 2014,which is a National Stage application, filed under 35 U.S.C. §371, ofInternational Application No. PCT/SE2014/050458, filed Apr. 14, 2014,the contents of all of which as are hereby incorporated by reference intheir entirety.

BACKGROUND

1. Related Field

The present invention relates to a method and a system for navigation ofan aerial vehicle. It also relates to a computer program and a computerprogram product for navigation of an aerial vehicle.

2. Description of Related Art

Navigation of vehicles, especially aerial vehicles, is today often basedon a global navigation satellite system (GNSS), like GPS. This has theadvantage that the position of the own vehicle is quite well knownwithin some uncertainty. It can, however, happen that a vehicle has totravel through an area where a GNSS-signal is denied, for example duringwar or conflicts, or since some entity for whatever reason usesinterfering transmitters to disturb GNSS-signals. Also technicalfailures might in principle cause GNSS-signal interruption.

To be able to navigate without GNSS some vehicles have inertialmeasurements units (IMU) on board. They can be used to keep track of thevehicle's current position using a process called dead reckoning. TheseIMU-systems have, however, the tendency that the calculated positionwill differ from the real position more and more with time. This is dueto the fact that errors entering the calculations add up. Therefore, thelonger the time a vehicle navigates with an IMU only, the bigger theuncertainty about the actual real position of that vehicle.

To lower the uncertainty of the actual real position and to lower thedifference between a calculated actual position and the real actualposition one can use an IMU with better components. This does, however,only lower the errors and the differences, whereas the total error andthe total uncertainty still increase as time goes by. On the other hand,an IMU with better components usually increases the weight of the IMUsubstantially. Especially for airborne vehicles, this can result in theconstraint that less fuel can be transported by the airborne vehicle andthat, depending on the size of the airborne vehicle, therefore the rangecan be lowered drastically. It exists therefore a need for a navigationmethod in GNSS denied areas wherein the position errors do not add upwith time.

EP 2 144 038 A2 discloses an inertial measurement using an imagingsensor and a digitized map. The system determines a vehicle's attitudeand position based on extracting at least three features out of imagedata. Depending on the environment the extraction of at least threefeatures can be different or even impossible to perform. Still GPS orsimilar systems are needed for determining an absolute position.

BRIEF SUMMARY

One object of the present disclosure is to provide navigation methods,systems, and aerial vehicles which seek to mitigate, alleviate oreliminate one or more of the above identified deficiencies in the artand disadvantages singly or in any combination.

This is achieved by a method for navigation of an aerial vehicle. Themethod comprises providing a sensor image from an aerial vehicle sensor.The method also comprises to repeatedly, until at least onepredetermined criterion is reached, perform the step of setting inputdata, where the input data comprises information related to pitch angle,roll angle, yaw angle and three-dimensional position of the aerialvehicle, the step of providing a two-dimensional image from a databasebased on the input data, where the database comprises three-dimensionalgeo-referenced information of the environment, and the step of comparingthe sensor image and the two dimensional image from the database. Themethod further comprises using the input data for which the two imagescorrespond best to each other for determining at least one of thefollowing quantities pitch angle, roll angle, yaw angle andthree-dimensional position of the aerial vehicle.

An advantage of such a method is that it not relies on a GNSS. Thus,this navigation method is especially suitable in GNSS-denied areas. Itfurther does not rely on feature extraction, thus being especiallyusable in areas where feature extraction would be difficult orimpossible to perform. The method has also the advantage of performingbetter than navigation based on an IMU only since the step of comparingimages is based on an absolute comparison, due to the fact that theinformation in the database is geo-referenced, and not on a relativecomparison to previously determined values as for IMU-only navigationmethods.

In one example the determined at least one quantity comprises thethree-dimensional position of the aerial vehicle.

This is often the most interesting quantity for navigation purposes.Thus, this example will be especially favourable for most navigationtasks. It has further the advantage that an error or an uncertaintyabout the real position of the vehicle does not increase over time.

In one example the method further comprises the steps of determining athree-dimensional position of the aerial vehicle based on a globalnavigation satellite system, GNSS, and comparing the determinedthree-dimensional position of the aerial vehicle based on the GNSS withthe determined three-dimensional position of the aerial vehicle wherethe input data for which the two images correspond best to each otherhas been used, so as to determine whether the GNSS is providing reliabledata.

By doing this knowledge is provided whether provided GNSS information istrustworthy or not. Thus a tool to detect a jammed and/or disturbedand/or spoofed GNSS is provided. It is also possible to detect when ajamming, disturbing or spoofing of the GNSS has diminished ordisappeared.

In one example the step of comparing the sensor image and the twodimensional image from the database comprises calculating a similaritymeasure between the two images.

In one example, the two images which correspond best to each other arethe two images which have the highest calculated similarity measurebetween the two images.

A similarity measure is usually a good indication of how well the imagescorrespond to each other, thus calculating a similarity measure allowsgiving an indication about how well the information related to theangles and the three-dimensional position of the aerial vehicle, whichis comprised in the input data, corresponds to the real angles andthree-dimensional position of the aerial vehicle.

In one example calculating a similarity measure between the two imagescomprises calculating a cross-correlation between the two images,preferably a normalised cross-correlation.

Calculating a cross-correlation is especially suitable for determininghow close the images are to each other. A normalised cross-correlation(NCC) provides a very usable and simple measure of correspondence, sincea NCC of 1 corresponds to perfect correspondence, a NCC of 0 correspondsto no correspondence at all, and the higher the NCC between 0 and 1 thebetter the correspondence between the images.

In one example the step of providing a two-dimensional image from adatabase based on the input data comprises providing the two-dimensionalimage from the database in such a way that it is projected onto thefield of view of the aerial vehicle sensor, where it is assumed that theaerial vehicle has its pitch angle, roll angle, yaw angle andthree-dimensional position according to the input data.

This is a preferred example of the method. The three-dimensionalgeo-referenced information of the environment comprised in the databasecan usually be used to be converted to a 3D-map or a 3D model. Thetwo-dimensional image from the database will then be provided as if acamera at the place of the sensor and with the same orientation as thesensor would have taken an image of the 3D-model or the 3D-map. Thus thesensor image and the image from the database should have the sametransformations and/or deformation of objects on the ground and of theground itself in the images. Having the same transformations and/ordeformations on images is a big advantage when comparing images, sinceerrors due to the transformation/deformation don't need to beconsidered, or at least need to be considered much less.

In one example the setting of the input data is updated in each step insuch a way as to find the best correspondence between the two images.

Target-oriented updating the input data highly reduces calculation time,or, if calculation time is fixed, gives a higher chance to find a bettercorrespondence between the images and thus better values for the atleast one quantity.

In one example the value of the normalised cross-correlation for the twoimages which correspond best to each other is used for calculating anuncertainty of the least one quantity.

This provides a simple method for determining an uncertainty of thedetermined at least one quantity.

In one example the predetermined criterion is that the steps arerepeated a predetermined number of times and/or that the bestcorrespondence between the two images which has been achieved so farconverges.

These are favourable criteria, since the first one assures a maximumtime for a calculation and the latter one that the calculation can befinished if no further significant improvements in the similaritymeasure can be achieved.

In one example an uncertainty in the three-dimensional geo-referencedinformation of the environment is used to calculate an uncertainty ofthe at least one quantity.

This allows for getting a measure for the reliability of the value ofthe at least one quantity, which might be helpful when calculating risksof specific decisions based on the determined at least one quantity. Forexample, when the uncertainty of the determined at least one quantity isso big that it cannot be assured that the aerial vehicle will not crashwhen taking a certain navigation route, it might be advisable to takeanother less risky route.

In one example sensor images from different aerial vehicle sensors areprovided and the method is performed independently for the sensor imageof each such aerial vehicle sensor, whereupon the determined at leastone quantity is a combination of the determined at least one quantityfor each independently performed method.

This allows for better determining the at least one quantity or fordetermining more of the at least one quantity since more sensor imagesare used. It also allows to use the method in more situations since onesensor image alone might not give reliable results under all conditions,for example, day/night-time, clouded/non-clouded sky, and so on.

In one example the combination of the determined at least one quantityfor each independently performed method is based on the reliabilityand/or accuracy of the sensors from which the sensor images areprovided.

This assures that information originating from more reliable and/or moreaccurate sensors contributed more to the determined at least one qualitythan information originating from less reliable and/or less accuratesensors, thus increasing the reliability and/or accuracy of thedetermined at least one quality.

In one example an initial setting of the input data comprisesinformation related to assumed real values for the aerial vehicle,especially information related to assumed real values for the pitchangle, the roll angle, the yaw angle and the three-dimensional positionof the aerial vehicle.

Doing this is usually a good starting point for determining the at leastone quantity, since it is the best guess one can make before performingthe method. Thus, having assumed real values as a starting point canboth reduce calculation time and it allows to say when a bettervalue/better values than the assumed value(s) for the determined atleast one quantity have been found.

In one example, the input data comprises pitch angle, roll angle, yawangle and three-dimensional position of the aerial vehicle, and thedetermined at least one quantity is the corresponding at least onequantity of the input data for which the two images correspond best toeach other.

The objective is also achieved by a system for navigation of an aerialvehicle. The system comprises a database, which containsthree-dimensional geo-referenced information of the environment. Thesystem also comprises at least one aerial vehicle sensor providing asensor image. The system further comprises a processing unit, which isarranged to receive the sensor image. The processing unit is alsoarranged to set input data comprising information related to pitchangle, roll angle, yaw angle and a three-dimensional position of theaerial vehicle. It is further arranged to provide two-dimensional imagesfrom the database based on the input data. It is even further arrangedto compare the sensor image with a two-dimensional images from thedatabase and to decide which of the two-dimensional images correspondsbest to the sensor image. It is yet even further arranged to determineat least one of the following quantities pitch angle, roll angle, yawangle and three-dimensional position of the aerial vehicle based on theinput data for which the best correspondence was achieved between one ofthe two-dimensional images and the sensor image. The processing unit isalso arranged to communicate said at least one quantity.

The system has the advantage that it does not rely on a GNSS. Thus, thissystem for navigation is especially suitable in GNSS-denied areas. Itfurther does not rely on feature extraction, thus being especiallyusable in areas where feature extraction would be difficult orimpossible to perform. The system further has the advantage that it canuse equipment, like sensors and/or a processing unit, which mightalready be provided on board the aerial vehicle. The system has also theadvantage of performing better than navigation based on an IMU onlysince the step of comparing images is based on an absolute comparison,due to the fact that the information in the database is geo-referenced,and not on a relative comparison to previously determined values as forIMU-only navigation methods.

In one embodiment the system further comprises a steering unit for theaerial vehicle, the steering unit being arranged to receive thecommunicated said at least one quantity.

This is especially suitable for navigation, since it allows the systembeing integrated with the control of the aerial vehicle. The control canbe man-based, like from a pilot or an operator, and/or machine-based,like an autopilot.

In one embodiment the system further comprises means for determining athree-dimensional position of the aerial vehicle based on a globalnavigation satellite system, GNSS. The processing unit is arranged todetermine at least the three-dimensional position of the aerial vehiclebased on the input data for which the best correspondence was achievedbetween one of the two-dimensional images and the sensor image. Theprocessing unit is further arranged to compare the determinedthree-dimensional position of the aerial vehicle based on the GNSS withsaid determined three-dimensional position of the aerial vehicle basedon the input data for which the best correspondence was achieved betweenone of the two-dimensional images and the sensor image. The processingunit is further arranged to determine whether the GNSS is providingreliable data based on said comparison of the determinedthree-dimensional positions.

In this embodiment knowledge is provided whether provided GNSSinformation is trustworthy or not. Thus a tool to detect a jammed and/ordisturbed and/or spoofed GNSS is provided. It is also possible to detectwhen a jamming, disturbing or spoofing of the GNSS has diminished ordisappeared.

In one embodiment the determined at least one quantity comprises thethree-dimensional position of the aerial vehicle.

One advantage is that an error or an uncertainty about the real positionof the vehicle then does not increase over time.

In one embodiment the processing unit is arranged to repeatedly performthe processes of setting input data, providing a two-dimensional image,and comparing the two-dimensional image with the sensor image until atleast one predetermined criterion is reached.

This is especially suitable for an optimisation procedure of thedetermined at least one quantity.

In one embodiment the system comprises several aerial vehicle sensors.Each sensor provides a sensor image. The processing unit is furtherarranged to perform independently for each sensor image said processesof receiving sensor images, setting input data, providingtwo-dimensional images, comparing images, and determining at least oneof the following quantities pitch angle, roll angle, yaw angle andthree-dimensional position of the aerial vehicle. The processing unit isfurther arranged to determine a combined at least one quantity based onthe corresponding determined at least one quantity for each sensorimage.

This allows for better determining the at least one quantity or fordetermining more of the at least one quantity since more sensor imagesare used. It also allows use of the system in more situations since onesensor image alone might not give reliable results under all conditions,for example, day/night-time, clouded/non-clouded sky, and so on.

In one embodiment the processing unit is further arranged to calculatean uncertainty for the determined at least one quantity based on anuncertainty in the three-dimensional geo-referenced information of theenvironment.

This allows for getting a measure for the reliability of the value ofthe at least one quantity, which might be helpful when calculating risksof specific decisions based on the determined at least one quantity. Forexample, when the uncertainty of the determined at least one quantity isso big that it cannot be assured that the aerial vehicle will not crashwhen taking a certain navigation route, it might be advisable to takeanother less risky route.

The object is also achieved by a computer program. The computer programcomprises a program code for navigation of an aerial vehicle. Thecomputer program also comprises the step of providing a sensor imagefrom an aerial vehicle sensor. It further comprises repeatedly, until atleast one predetermined criterion is reached, performing the step ofsetting input data comprising information related to pitch angle, rollangle, yaw angle and three-dimensional position of the aerial vehicle,the step of providing a two-dimensional image from a database based onthe input data, where the database comprises three-dimensionalgeo-referenced information of the environment, and the step of comparingthe sensor image and the two dimensional image from the database. Italso comprises using the input data for which the two images correspondbest to each other for determining at least one of the followingquantities pitch angle, roll angle, yaw angle and three-dimensionalposition of the aerial vehicle.

The object is also achieved by a computer program product whichcomprises a program code stored on a computer readable media fornavigation of an aerial vehicle. The computer program product alsocomprises the step of providing a sensor image from an aerial vehiclesensor. It further comprises repeatedly, until at least onepredetermined criterion is reached, performing the step of setting inputdata comprising information related to pitch angle, roll angle, yawangle and three-dimensional position of the aerial vehicle, the step ofproviding a two-dimensional image from a database based on the inputdata, where the database comprises three-dimensional geo-referencedinformation of the environment, and the step of comparing the sensorimage and the two dimensional image from the database. It also comprisesusing the input data for which the two images correspond best to eachother for determining at least one of the following quantities pitchangle, roll angle, yaw angle and three-dimensional position of theaerial vehicle.

Further advantages of the present invention are, among others, that anIMU can be omitted in one example and/or one embodiment and that thesize and/or weight of the system can be made smaller than the omittedIMU, thus saving space and/or weight of the aerial vehicle andincreasing its range.

Yet a further advantage of the present invention is, among others, thatin one embodiment a simpler IMU can be used, which preferably is smallerand has less weight than previously used IMUs. This is due to not beingreliable on the accuracy of the IMU for navigating the aerial vehicle ina GNSS-denied area. The used system can then be made smaller and/or lessweighted than the saved space and/or weight through the simpler IMU,thus increasing the range of the vehicle.

All examples and exemplary embodiments described herein are non-limitingin nature and thus should not be construed as limiting the scope of theinvention described herein. Still further, the advantages describedherein, even where identified with respect to a particular exemplaryembodiment, should not be necessarily construed in such a limitingfashion.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Having thus described the invention in general terms, reference will nowbe made to the accompanying drawings, which are not necessarily drawn toscale, and wherein:

FIG. 1 a depicts schematically a situation where the present inventioncan be used.

FIG. 1 b depicts schematically what happens in a GNSS-denied area in aprior art situation.

FIG. 2 shows a flow diagram of a method for navigation of an aerialvehicle according to the present invention.

FIG. 3 shows a flow diagram of an extended method for navigation of anaerial vehicle according to the present invention.

FIG. 4 shows a sketch illustrating one example over how atwo-dimensional image is provided from a database according to thepresent invention.

FIG. 5 shows a schematic sketch of system for navigation of an aerialvehicle according to the present invention.

DETAILED DESCRIPTION OF VARIOUS EMBODIMENTS

Various embodiments of the present invention will now be described morefully hereinafter with reference to the accompanying drawings, in whichsome, but not all embodiments of the invention are shown. Indeed,embodiments of the invention may be embodied in many different forms andshould not be construed as limited to the embodiments set forth herein.Rather, these embodiments are provided so that this disclosure willsatisfy applicable legal requirements. Unless otherwise defined, alltechnical and scientific terms used herein have the same meaning ascommonly known and understood by one of ordinary skill in the art towhich the invention relates. The term “or” is used herein in both thealternative and conjunctive sense, unless otherwise indicated. Likenumbers refer to like elements throughout.

Still further, to facilitate the understanding of this invention, anumber of terms are defined below. Terms defined herein have meanings ascommonly understood by a person of ordinary skill in the areas relevantto the present invention. Terms such as “a”, “an” and “the” are notintended to refer to only a singular entity, but include the generalclass of which a specific example may be used for illustration. Theterminology herein is used to describe specific embodiments of theinvention, but their usage does not delimit the invention, except asoutlined in the claims.

FIG. 1 a depicts schematically a situation 10 where the presentdisclosure can be used. An aerial vehicle will start at some startingpoint 11. The aerial vehicle can be any kind of aerial vehicle. In oneexample the aerial vehicle is an airplane or a helicopter. The aerialvehicle can be manned or unmanned. In one example the aerial vehicle isan unmanned aerial vehicle, UAV. The aerial vehicle can also be anaerial vehicle, which is not supposed to return to the starting point11, like a missile or a rocket. The aerial vehicle can in principle beany kind of aerial vehicle, both a civilian and a military aerialvehicle. In one example the aerial vehicle has an IMU. In one examplethe aerial vehicle has means for receiving data provided from a GNSS andmeans for calculating the own position based on the GNSS-data. Thestarting point 11 can be any kind of starting point. In one example, thestarting point is an aerodrome like an airport, an airfield, or a rocketlaunch site. It can also be a carrier. In one example the starting pointis a missile launching unit. This can be situated on a naval unit, on aland-based unit or on an aerial unit. The aerial vehicle will afterstart from the starting point 11 fly along a flight path 12. In theexample of FIG. 1 a the flight path 12 returns to the starting point 11.In another example the flight path will go to a separate landing point.In yet another example the flight path will end at some point, forexample a military target. This can be a land-based target, awater-based target or an air-based target. The flight path 12 can bepre-determined or not. In one example the flight path 12 will be changedduring flight of the aerial vehicle. In general, the position and theattitude of the aerial vehicle at the starting point 11 is known. Thiscan be due to sensors on the aerial vehicle. This can also be due tosurveying of the starting point. It can also be due to sensors and/orsome other pre-knowledge on the starting point, especially in case thestarting point is moving. In one example the position and attitude ofthe starting point is known based on sensors of a carrier or anotheraerial vehicle. It can also be based on a GNSS, like GPS.

The aerial vehicle usually has a navigation system which is arranged todetermine an absolute position of the vehicle. This is, however, not aprerequisite of the present invention. In case the aerial vehicle has asystem to determine the absolute position, this system is based on aGNSS. Thus, the system might be vulnerable to technical failures of theGNSS, to service denial of the GNSS or to jamming. In the example ofFIG. 1 a the dotted line 14 indicates the border between an area wherethe GNSS reliably works (the area which is below and left of line 14)and an area where the GNSS does not reliably work (the area which isabove and right of the line 14). In the example of FIG. 1 a the aerialvehicle thus has to find another way to determine its position on theflight path 13.

In the following, when referring to a GNSS-denied area here and in thewhole document, this can be due to any reason. It should not onlycomprise the case of actively denying GNSS, but also the case of GNSSdenial due to technical reasons or due to any possible disturbance. TheGNSS-denied area can in one example also comprise the starting point 11.In one example, the whole flight path is comprised in the GNSS-deniedarea. In another example different parts of flight path are comprised inthe GNSS-denied area. The GNSS-denied area can also change during flightof the aerial vehicle.

The aerial vehicle will have some initial values for attitude andposition before entering the GNSS-denied area. This can be due to thenavigation system which includes a GNSS and which works before enteringthe GNSS-denied area, and/or it can be due to the knowledge of positionand attitude from the starting 11 as described above.

The present disclosure can also be used in areas which are notGNSS-denied. In this case the disclosure can be used to check thevalidity of GNSS-data and/or the drift of an IMU. The invention can thenalso be used for increasing the position and/or attitude accuracycompared to only relying on GNSS and/or IMU.

FIG. 1 b depicts schematically what happens with an aerial vehicle 20 ina GNSS-denied area in a prior art situation. The situation of FIG. 1 bis not related to a real scale between the objects. An aerial vehicle 20might enter the GNSS-denied area at 21. Before entering, its positioncould be determined with the help of a GNSS like GPS. After entering theGNSS-denied area the aerial vehicle 20 will travel along path 22. Fordetermining its position, the aerial vehicle 20 will have to rely on anIMU since its GPS-receiver will not any longer be able to receive thesignals needed to determine its position. The positions determined viathe IMU and thus the travel path 23 determined via the IMU will,however, differ from the real travel path 22. The difference will bebigger the more the time advances, as indicated in the figure and asdescribed in the background section.

FIG. 2 shows a flow diagram of a method 100 for navigation of an aerialvehicle according to the present disclosure. The method starts with thestep 110 of providing a sensor image from an aerial vehicle sensor. Hereand in the whole document, when referring to a sensor image, it isalways assumed that the sensor image is from an aerial vehicle sensorunless explicitly stated otherwise. The aerial vehicle sensor can be anykind of sensor which allows providing images from the environment, i.e.from the ground over which the aerial vehicle is flying. In one examplethe aerial vehicle sensor is a camera. In one example the aerial vehiclesensor is a camera based on charge-coupled device (CCD) technology. Inone example the aerial sensor is a camera based on complementarymetal-oxide-semiconductor (CMOS) technology. The aerial vehicle sensorcan also comprise laser or radar elements. In one example the aerialvehicle sensor is operating with at visible light wavelengths. In oneexample the aerial vehicle sensor is operating at infra-red (IR) and/orat ultraviolet (UV) wavelength(s). There are many different kinds ofaerial vehicle sensors which can provide sensor images and a personskilled in the art will appreciate that different types of sensors havedifferent advantages and disadvantages and can be chosen according tothe intended use of the invention. For example, the choice of sensor canbe based on whether the sensor should be able to provide sensor imageseven during night or not, whether it should be able to provide imagesduring cloudy conditions, how much it should cost, and so on. If onesensor is not able to fulfil all requirements different sensors arecombined for providing a sensor images. In one example different sensorscan be used to provide different sensor images. This will be furtherdescribed in relation to FIG. 3. It is well known in the art how toconvert sensor output into sensor images. Thus, this will not bedescribed here any further. In one example the sensor image isrepresented as data bits and/or in other electronic representations forfurther processing. The method continues with step 120. Step 110 doesnot necessarily need to be performed as the first step. In anotherexample, step 110 is performed at any moment of time before step 140 isperformed. This other example is also part of the present invention andcovered by the wording of the independent claims.

In step 120 input data is set which comprises information related topitch angle, roll angle, yaw angle and a three-dimensional position ofthe aerial vehicle. In one example, initial input data used in a firstiteration of the method comprises information related to assumed realvalues for the aerial vehicle, especially information related to assumedreal values for the pitch angle, the roll angle, the yaw angle and thethree-dimensional position of the aerial vehicle. Information relatingto assumed real values for the pitch angle, the roll angle and the yawangle are in one example provided by an IMU. In case the aerial vehicleis not in a GNSS-denied area, information to an assumed real value forthe three-dimensional position of the aerial vehicle is provided from aGNSS. In one example, the information related to assumed real values forthe aerial vehicle is calculated based on the last known position andrelative position data. In one example the relative position data isbased on data from an IMU, on the speed of the aerial vehicle and thetime since the last known position. The last known position is oneexample the last known position before entering a GNSS-denied area. Inone example the last known position is based on the known position ofthe starting point. In one example the last known position is based onthe outcome of a method according to the present disclosure which hasbeen performed at an earlier time. It is known in the art how tocalculate assumed real values for a three-dimensional position of anaerial vehicle based on the last known position and relative positiondata. Therefore, this is not described here any further. The methodcontinues with step 130.

In step 130 a two-dimensional image from a database is provided based onthe input data. The database comprises three-dimensional geo-referencedinformation of the environment. In one example the three-dimensionalgeo-referenced information of the environment is a 3D map of theenvironment. In one example the three-dimensional geo-referencedinformation of the environment is a 3D model of the environment. The 3Dmodel could be any kind of 3D model known to those skilled in the art.In one example, the 3D model is represented as a mesh. In anotherexample the 3D model is represented as a surface representation. Inanother example the 3D model is represented as a voxel representation.In one example the 3D model includes texture information. In one examplethe 3D model is a point cloud. In one example the three-dimensionalgeo-referenced information of the environment is represented in such away that a 3D model or a 3D map of the environment could be constructedbased on the information. In one example the 3D map is a triangularirregular network (tin)-based mesh draped with textures. In one example,a positional or mesh uncertainty is associated to at least some of thenodes/surfaces/edges of the mesh. The mesh uncertainty associated toeach respective node/surface/edge represents the uncertainty at thatspecific point of the model.

It is assumed that the relation between the aerial vehicle and theaerial vehicle sensor from which the sensor image is provided is known.In one example the aerial vehicle sensor is fixedly mounted on theaerial vehicle without any degree of freedom to change its orientationor its position relative to the aerial vehicle. In another example theaerial vehicle sensor has one or more degree of freedoms to change itsposition and/or orientation relative to the aerial vehicle. This changeis then tracked so that the relation between the aerial vehicle and theaerial vehicle sensor from which the sensor image is provided is known.Thus, since the input data comprises information related to pitch angle,roll angle, yaw angle and three-dimensional position of the aerialvehicle, this information also relates to the orientation (i.e.attitude) and position of the aerial vehicle sensor.

The two-dimensional image from the database is then preferably providedin such a way that it corresponds to the sensor image. This is describedin further detail in relation to FIG. 4. The method continues with step140.

In step 140 the sensor image and the two dimensional image from thedatabase are compared. In one example the comparison comprisescalculating a similarity measure between the two images. In one examplecalculating a similarity measure between the two images comprisescalculating mutual information. In one example calculating a similaritymeasure between the two images comprises calculating a chamfer matching.In one example calculating a similarity measure between the two imagescomprises calculating a phase correlation. In one example calculating asimilarity measure between the two images comprises calculating amathematical correlation, preferably a cross-correlation between the twoimages, preferably a normalised cross-correlation. A skilled person willrealise that there are more similarity measures known in the art whichcan be calculated here. The aim of this step is to get an indicationabout how well the two images match each other. In one example a valuesis calculated representing the degree of matching. In one examplecalculating the value comprises using one or more convolutioncalculations. In one example the value is a scalar. In another examplethe value is a higher-dimensional object. In one example the value isthe normalised cross-correlation. The normalised cross-correlation canthen take a value between zero and one, where zero corresponds to nomatch at all between the two images and one stands for fullcorrespondence between the two images. In one example a similaritymeasure is filtered. If the sensor image fully corresponds to thetwo-dimensional image from the database one can assume that the pitchangle, roll angle, yaw angle and three-dimensional position of theaerial vehicle to which the information in the input data relates arethe true values for the pitch angle, roll angle, yaw angle andthree-dimensional position of the aerial vehicle. If they do not fullycorrespond, one can, for example, take the value of the normalisedcross-correlation as a measure of how well the two images correspond toeach other. The higher the value is, the better the correspondence. Themethod continues with step 150.

In step 150 it is checked whether a predetermined condition (i.e.criterion) is fulfilled. This predetermined condition is in one examplewhether the method has been performed a predetermined number of times ornot. In one example the predetermined condition is whether thecomparison arrived in step 140 reached or surpassed a certain amount ofcorrespondence between the two images. This is, for example, that thenormalised cross-correlation reached or surpassed a specific value. Inone example the predetermined condition is that the best correspondencebetween the two images which has been achieved so far converges. Alsoother predetermined conditions are possible, isolated or in combination.Several predetermined conditions can be combined so that one or all ofthem have to be fulfilled.

If the predetermined condition is fulfilled, the method continues withstep 160.

If the predetermined condition is not fulfilled, the method continueswith step 120, where new input data is set. The new input data is in oneexample based on the previous input data and on the comparison betweenthe two images. In one example the input data is changed in such a waythat it is likely that a better comparison, for example, a bettercorrespondence, will be achieved the next time step 140 is performed.This can in one example be achieved by looking at the gradient of thesimilarity measure and to set the new input data in the direction of thehighest gradient. A convergence of the best correspondence, as namedabove, is then in one example achieved if the magnitude of the gradientis below a predetermined value. The way of setting new input data canalso comprise other methods known in the art for finding a bestcorrespondence, for example methods for detecting whether a global or alocal maximum has been achieved for the similarity measure between thetwo images, for example for the normalised cross-correlation.

In step 160 at least one of the following quantities pitch angle, rollangle, yaw angle and three-dimensional position of the aerial vehicle isdetermined. In a preferred example the at least one quantity comprisesthe three-dimensional position of the aerial vehicle. For determiningthe at least one quantity the input data for which the two imagescorrespond best to each other is used. In one example the input datacomprises pitch angle, roll angle, yaw angle and three-dimensionalposition of the aerial vehicle and the determined at least one quantityis then the corresponding at least one quantity from the input data forwhich the two images correspond best to each other. In one example theinput data comprises information related to pitch angle, roll angle, yawangle and three-dimensional position of the aerial vehicle and the atleast one quantity is then determined using information relating to thecorresponding at least one quantity from the input data. Thisinformation is then in one example used to calculate the correspondingat least quantity.

The input data for which the two images correspond best to each other isconsidered being the input data among all used input data which bestcorresponds to the real values for pitch angle, roll angle, yaw angleand three-dimensional position of the aerial vehicle. Thus, using thisinput data for determining the at least one quantity will likely givethe best possible estimate of the real pitch angle, roll angle, yawangle and three-dimensional position of the aerial vehicle. However, notall of these quantities have to be determined. For navigation purposesit is in one example enough to only determine the three-dimensionalposition of the aerial vehicle and taking values for the otherquantities from other sources, for example an IMU. In another example,more or all of the quantities are determined from the method of thisdisclosure. In a different example, when not operating in a GNSS-deniedarea and the aerial vehicle is equipped with, for example, aGPS-receiver, one can use the method to determine the pitch angle, rollangle, and/or yaw angle of the aerial vehicle. It is obvious that evenother combinations of the at least one quantities can be determined.This might depend on the specific circumstance and can be adapted to thespecific needs in every circumstance.

In one example, an uncertainty for the at least one determined quantityis calculated. In one example, when a normalised cross-correlation iscalculated, the uncertainty of the at least one quantity is based on thevalue of the normalised cross-correlation. For example, a normalisedcross-correlation of 1 corresponds to a perfect correspondence betweenthe two images. Then the uncertainty in the at least one quantity isbasically zero. The more the normalised cross-correlation is below 1,the higher is the discrepancy between the two images and thus the higherthe uncertainty in the determined at least one quantity. If thethree-dimensional geo-referenced information comprises uncertaintyvalues this can be used as well for calculating an uncertainty of thedetermined at least one quantity. In one example the uncertainty of thedetermined at least one quantity is based on the uncertainty in thethree-dimensional geo-referenced information.

The method ends after step 160.

In one example of method 100 sensor fusion algorithms are used. In oneexample information relating to the similarity measure is used in asensor fusion algorithm together with data from the IMU and/ormeasurement data from other possible sensors at the aerial vehicle. Inone example a Kalman filter is used for sensor fusion algorithms. In oneexample time filtering is used. In one example the time filtering isperformed based on a Kalman filter. In one example the time filtering isperformed based on a particle filter. In one example the time filteringis performed based on another time filter known in the art. By using anyof the aforementioned filters and/or algorithms one can exploit thehitherto described uncertainties and/or possible other measurementuncertainties for increasing the accuracy and/or reducing theuncertainty of the determined at least one quantity. In one example thechoice of new input data is based on an output of at least one of theaforementioned filters and/or algorithms.

In case no good assumptions are present for an initial setting of theinput data, the method 100 can also be performed, in parallel orsequentially, with different input data settings to get a first idea ofwhich input data might come close to real values of the pitch angle,roll angle, yaw angle and three-dimensional position of the aerialvehicle.

In a preferred example the method 100 is performed on and on again forperiodically determining the at least one quantity as the aerial vehicleproceeds its travel.

In one example the determined at least one quantity in step 160comprises the determined three-dimensional position of the aerial, andthe method 100 does not end after step 160. Instead, the method furthercomprises the step 170 of determining a three-dimensional position ofthe aerial vehicle based on a global navigation satellite system, GNSS.This additional step 170 is not pictured in FIG. 2 and can be performedindependently of the steps 110-160.

The method 100 then comprises one more additional step 180 (not shown inFIG. 2). This step 180 can be performed after step 160 and step 170 hasbeen performed. In step 180 the determined three-dimensional position ofthe aerial vehicle based on a GNSS is compared with the determinedthree-dimensional position of the aerial vehicle where the input datafor which the two images correspond best to each other has been used.This comparison is done in such a way so as to determine whether theGNSS is providing reliable data.

In one example, it is concluded that the GNSS is providing reliable dataif the difference between the determined three-dimensional position instep 160 and step 170 is below a pre-determined threshold. Thedifference refers in one example to an absolute value of athree-dimensional difference.

When it is determined that the GNSS is not providing reliable data onecan in one example decide to deactivate systems which rely on inputsfrom GNSS-data, or decide to replace the GNSS-data by other kind ofdata, for example data relating to the determined at least one quantityfrom step 160.

After step 180 the method 100 ends.

In FIG. 3 a flow diagram of an extended method 200 for navigation of anaerial vehicle according to the present invention is shown. The methodstarts with step 210.

In step 210 several sensor images are provided. The sensor images areprovided from different aerial vehicle sensors and they are provided atbasically the same time. At a preferred example the maximum differencebetween the moments of time when any of the sensor images are taken isso low that the aerial vehicle travels, during that time, a distancewhich is less than the resolution accuracy of the sensors and/or lessthan the accuracy and/or uncertainty of the geo-referenced informationof the environment. The sensor images do not necessarily need to be ofthe same part of the environment. The aerial vehicle sensors providingthe sensor images can have different field of views, differentorientations, work at different wavelengths, and so on. Every providedsensor image is provided as described for a single sensor image in step110 of FIG. 2. An advantage of using several aerial vehicle sensors isthat different sensors might cover different wavelengths. A sensor whichis good under day-light condition might not be good during night andvice versa. Also, different wavelengths might be interesting at the sametime, but there might be no common sensors for all these wavelengths, ora common sensor would be too heavy, too big, too expansive, or for anyother reason less suited than different sensors for differentwavelengths. All of this might motivate using several sensors. Yetanother reason might be that different sensors are already installed atthe aerial vehicle for other purposes and thus might be anyhow availablefor the present invention. After providing several sensor images themethod continues with step 220.

In step 220 the method as described in step 120 until step 160 of FIG. 2is performed independently for each sensor image. Thus, the method canbe performed for each sensor image in parallel, in sequence, or anycombination thereof. It should also be noted, that the step 210 ofproviding sensor image can be performed at any time before step 140 isperformed for the first time. In one example, step 210 is performedbefore step 120. In one example step 210 is performed before step 140.This corresponds to the description of step 110. The method continueswith step 230.

In step 230 at least one quantities is determined via combining the atleast one quantities from step 230. In one example, different at leastone quantities have been determined in step 220. For example, athree-dimensional position of the aerial vehicle is determined from onesensor image and at least one from pitch angle, roll angle and yaw angleis determined from another sensor image. The different quantities fromthe different sensor images are then combined to a total at least onequantity comprising them.

In another example, the same at least one quantity is determined fromdifferent sensor images. In this case the values of the at least onequantity are combined to end up at a combined at least one quantity ofthe aerial vehicle. In one example, the combining process comprisestaking the mean value of the values of the at least one quantity fromthe different sensor images. However, any other method of combiningvalues or quantities which is known in the art may be utilised as well.In one example, the combination of the determined at least one quantityfor each independently performed method is based on the reliabilityand/or accuracy of the sensors from which the sensor images areprovided. One sensor might, for example, have a higher accuracy for thesensor image than another sensor. The sensor image with the higheraccuracy might then contribute more for determining the combined atleast one value than the sensor image with less accuracy. One sensormight, for example, not work reliably during certain daytimes or duringcertain other conditions (for example, temperature, pressure, etc.).Then it might be advantageous to give sensor images from sensors withhigher reliability more weight for determining the combined at least onequantity compared to less reliable sensors. In the most extreme casesone sensor image could have zero weight. This is, for example, if thesensor providing that sensor image has no reliability at all under givencircumstances.

It is also possible to combine the above described techniques, i.e.combining the cases that different at least one qualities are determinedfrom different sensor images and that different values for the same atleast one quality are taken from different sensor images.

The method ends after step 230.

What is described in relation to fusion algorithms with method 100applies to method 200 as well.

FIG. 4 shows a sketch illustrating one example over how atwo-dimensional image 430 is provided from a database 410 according tothe present disclosure. The database 410 comprises three-dimensionalgeo-referenced information of the environment, for example as describedin relation to step 130. In one example, the database 410 is on board ofthe aerial vehicle 450. This has the advantage that the time for theaerial vehicle 450 to access the database 410 is minimised, which can beimportant for navigation purposes. Another advantage is that thedatabase 410 is easily available for the aerial vehicle 450 which thenneeds not to rely on radio communication and/or communication to asatellite. This will make the navigation system of the aerial vehicle450 less vulnerable. In one example the database 410 is stored on anon-volatile memory on board the aerial vehicle. In another example thedatabase 410 is stored externally, i.e. not on board the aerial vehicle450. In one example the database 410 is stored on a closed by aerialvehicle. In another example the database 410 is stored on a water-basedor land-based facility or vehicle. The database 410 can in principle beplaced anywhere as long as there is the possibility for the aerialvehicle 450 to access the database 410. In one example this is achievedvia a communication channel.

The aerial vehicle 450 is then arranged to provide sensor images from atleast one aerial vehicle sensor (not shown). In FIG. 4 it is forsimplicity assumed that only one aerial vehicle sensor is present. Itis, however, possible to use several aerial vehicle sensors as describedearlier. The aerial vehicle sensor has its field of view which islimited by borders 465 and will then provide a sensor image 460 from theenvironment 470. The sensor image 460 will show that part of theenvironment 470 which is limited by the intersections of the field ofview borders 465 with the environment 470, i.e. which is limited by theintersection lines 460 a, 460 b, 460 c, 460 d. This is indicated in FIG.4. One should, however, observe that these intersection lines 460 a, 460b, 460 c, 460 d in general are not straight lines but rather curved dueto the three-dimensional shape of the environment. The sensor imageitself as seen by the sensor is, however, in general still rectangularas with any standard image. These relations are very well known in theart and thus not described any further here.

Having input data comprising information related to pitch angle, rollangle, yaw angle and three-dimensional position of the aerial vehicle,and thus related to pitch angle, roll angle, yaw angle andthree-dimensional position of the aerial vehicle sensor as describedabove, one can then provide 420 a two-dimensional image 430 from thedatabase based on the input data. Preferably, the two-dimensional imagefrom the database is provided in such a way that it is projected ontothe field of view of the aerial vehicle sensor, where it is assumed thatthe aerial vehicle has its pitch angle, roll angle, yaw angle andthree-dimensional position according to the input data.

The image 430 provided from the database will then have the sameorientation and intersection lines as the image 460, and thethree-dimensional geo-referenced information 440 of the environmentwhich is comprised in the database 410 will relate to the sameenvironment 470 as seen by the sensor. Thus, the image 430 provided fromthe database 410 will correspond to the sensor image 460 as seen by theaerial vehicle sensor. This means that both images will have the samedeformation of objects due to the viewing direction and thethree-dimensional shape of the environment 440, 470. The image 430 fromthe database 410 will thus be as if it would have been taken by a sensorwith the pitch angle, roll angle, yaw angle and three-dimensionalposition according to the input data. When the image then will becompared in step 140 of FIG. 2, one can determine how well the imagescorrespond to each other, as described in relation to FIG. 2. When theimages don't perfectly fit each other this can, among other things, bedue to that the angles and/or position of the aerial vehicle where theinformation relating to it is comprised in the input data is notcorrect. For example, the real three-dimensional position of the aerialvehicle might be shifted compared to the three-dimensional position ofthe aerial vehicle which is assumed in the input data. Then, especiallya calculated cross-correlation between the images which involvescalculating convolution can give an estimate about how big this shiftingis, so that the input data can be adapted accordingly when the inputdata is set 120 the next time in FIG. 2. The new assumption of inputdata can then be tested in the next run as described earlier.

In one example, one or more uncertainties in the image 430, whichoriginate from uncertainties in the geo-referenced information of theenvironment as stored in the database 410, are used to determine anuncertainty for the determined at least one quality as described inrelation to FIG. 2, especially an uncertainty for the determinedthree-dimensional position of the aerial vehicle 450.

In FIG. 5 a schematic sketch of a system 300 for navigation of an aerialvehicle according to the present invention is shown. The system containsa database 310 which contains three-dimensional geo-referencedinformation of the environment. The database 310 corresponds in oneexample to the database 410 described in relation to FIG. 4.

The system 300 further comprises at least one aerial vehicle sensor 320.The at least one aerial vehicle sensor 320 is arranged to provide asensor image. In one embodiment the at least one sensor 320 comprisesseveral sensors 320 a, 320 b, 320 c . . . . In one embodiment the atleast one sensor is arranged to provide several sensor images. In oneembodiment the at least one sensor 320 comprises an infrared sensor 320a. In one embodiment the at least one sensor 320 comprises a sensor 320b which can detect in the visible wavelength-range. In one embodimentthe at least one sensor 320 comprises a sensor 320 c receiving laserand/or radar signals. In one embodiment the at least one sensor 320comprises a synthetic aperture radar (SAR). In one embodiment the atleast one sensor 320 comprises one or more cameras as described inrelation with FIG. 2. In one example said one or more camera is at leastone of an infrared camera, an ultraviolet camera, a multispectral cameraor a hyperspectral camera.

The system 300 further comprises a processing unit 330. The processingunit is arranged to receive the sensor image. In case the at least onesensor provides several sensor images the processing unit is arranged toreceive these several sensor images.

The processor unit 330 is further arranged to set input data comprisinginformation related to pitch angle, roll angle, yaw angle and athree-dimensional position of the aerial vehicle. In one embodiment thesystem 300 comprises a GNSS-receiver 340. The GNSS-receiver 340 is thenarranged to send data regarding a position of the aerial vehicle to theprocessing unit 330. In one embodiment the GNSS-receiver is arranged todetermine a three-dimensional position of the aerial vehicle based on aGNSS. In one embodiment the system 300 comprises an IMU 341. The IMU 341is then arranged to send data regarding pitch angle, yaw angle, and/orroll angle to the processing unit 330. The processing unit is thenarranged to receive the data from the IMU 341 and/or the GNSS-receiver340 and to use this data for setting initial values for the input dataas described earlier. Here, the term GNSS-receiver 340 does alsocomprise that the information received by the GNSS-receiver is used todetermine a three-dimensional position of the aerial vehicle if not in aGNSS-denied area. This can be done either in the GNSS-receiver 340, orat some other element, for example the processing unit 330.

The processing unit 330 is further arranged to provide two-dimensionalimages from the database based on the input data. It is also arranged tocompare the sensor image with a two-dimensional images from thedatabase, to decide which of the two-dimensional images corresponds bestto the sensor image, and to determine at least one of the followingquantities pitch angle, roll angle, yaw angle and three-dimensionalposition of the aerial vehicle based on the input data for which thebest correspondence was achieved between one of the two-dimensionalimages and the sensor image. These processes are as well describedabove, especially in relation to FIG. 2.

The processing unit 330 is even further arranged to communicate said atleast one quantity. In one embodiment the at least one quantity is,directly or indirectly, communicated to a pilot of the aerial vehicle.In one embodiment the at least one quantity is, directly or indirectly,communicated to an operator of the aerial vehicle.

In one embodiment the processing unit 330 is arranged to determine athree-dimensional position of the aerial vehicle based on a globalnavigation satellite system, GNSS. This is one example based on the dataregarding a position of the aerial vehicle which is sent from theGNSS-receiver 340. In one embodiment that processing unit 330 isarranged to compare the determined three-dimensional position of theaerial vehicle based on the GNSS with the determined three-dimensionalposition of the aerial vehicle where the input data for which the twoimages correspond best to each other has been used, The processing unit330 is then further arranged to determine whether the GNSS is providingreliable data based on that comparison.

In one embodiment the system 300 further comprises a steering unit 350for the aerial vehicle, the steering unit being arranged to receive thecommunicated said at least one quantity from the processing unit 330.The steering unit comprises in one embodiment an autopilot.

In a preferred embodiment all parts of the system 300 are on board theaerial vehicle. However, in one embodiment parts of the system mightalso be at other places. This has been described before.

Some parts of the system might be at different places at the aerialvehicle, while other parts might be close together or even integrated toeach other. In one embodiment the processing unit 330 and the steeringunit 350 are integrated.

In one embodiment the system 300 further comprises a GNSS-controlleddevice 355. This GNSS-controlled device is in one example a weapon, forexample a GPS-controlled weapon. The processing unit 330 can then bearranged to send input data to the GNSS-controlled device. This inputdata can comprise information relating to the fact whether the GNSS isjammed, disturbed, or not providing reliable data for whatever otherreason. In one example the input data comprises said determined at leastone of the following quantities pitch angle, roll angle, yaw angle andthree-dimensional position of the aerial vehicle.

In a preferred embodiment the at least one quality determined by theprocessing unit 330 is the three-dimensional position of the aerialvehicle.

In one embodiment the processing unit 330 is arranged to repeatedlyperform the processes of setting input data, providing a two-dimensionalimage, and comparing the two-dimensional image with the sensor imageuntil at least one predetermined criterion is reached. Afterwards the atleast one quantity is determined. The process of doing this is describedin more detail in relation to FIG. 2.

In one embodiment, the processing unit 330 is further arranged tocalculate an uncertainty for the determined at least one quantity basedon an uncertainty in the three-dimensional geo-referenced information ofthe environment. The uncertainty for the determined at least onequantity can then be communicated in the same way as the at least onequantity. Having an uncertainty for the at least one quantity allows forthe receiver (for example, pilot, operator, steering system, etc.) ofthe at least one quantity to make decisions of how to operate the aerialvehicle based on this uncertainty. Thus, certain decisions might only betaken if the uncertainty is, for example, below a certain value.

In one embodiment, when the system 300 comprises several aerial vehiclesensors 320 a, 320 b, 320 c . . . , the processing unit 330 is furtherarranged to perform independently for each sensor image the earlierdescribed processes of receiving sensor images, setting input data,providing two-dimensional images, comparing images, and determining atleast one of the following quantities pitch angle, roll angle, yaw angleand three-dimensional position of the aerial vehicle. The processingunit is then even further arranged to determine a combined at least onequantity based on the corresponding determined at least one quantity foreach sensor image. This is described in more detail in relation to FIG.3.

In one embodiment the processing unit 330 is arranged to receive datafrom further input elements. In one embodiment a further input elementis a barometer 360. In one embodiment a further input element is anaerometer 361. In one embodiment a further input element is an inputelement 362 for receiving inputs from a pilot or an operator of theaerial vehicle. The further input elements are in one embodiment usedfor receiving information about pressure, air, water, and/or theenvironment. This information can then be used for further improving thesystem 300. For example, a sensor image from a land area is in generalbetter for performing the invention than a sensor image from a waterarea. This is due to the fact that the variations of a land area, bothin its geometrical shape and in its texture, in general are morepronounced than variations of a water area. Thus, in one embodiment,when several aerial vehicle sensors 320 are present, the additionalinput elements can be used to determine which of the sensors areproviding sensor images from land areas and which of the sensors areproviding sensor images from water areas. The processing unit 330 canthen, for example, decide to adapt the reliability of the sensor imagesaccordingly when determining the combined at least one quality. In oneembodiment, the further input elements are used to determine whether theat least one sensor 320 is only providing sensor images from water areasor not. The system 300 can then in one embodiment decide not to trust onthe determined at least one quantity if all used sensor images only arefrom water areas. In this case the system 300 might decide to only useother ways of navigation, for example information from an IMU 341, untilat least one sensor provides sensor images from a land area again.

In one embodiment, the system 300 is also used to calibrate one or, ifapplicable, more of the at least one sensor 320. Preferably, the atleast one sensor 320 is calibrated before start of the aerial vehicle.If this, however, is not possible or a re-calibration is needed, thiscan in one embodiment be performed by the system 300 before the aerialvehicle enters a GNSS-denied area. For doing so the initial input datais set in such a way that the information relating to thethree-dimensional position of the aerial vehicle corresponds to thethree-dimensional position of the aerial vehicle as determined based ona GNSS-receiver 340 (and, if applicable, based on further inputelements, such as, for example, a barometer 360). When then the imagesare compared in step 140 (as described in relation to FIG. 2), across-correlation can be determined. The two images should correspondperfectly to each other, up to some uncertainties, since the realposition is known due to the GNSS and this is used together with realvalues for the angles in the input data for providing thetwo-dimensional image from the database 310. Thus, apart fromuncertainties, any discrepancies should originate from non-calibratedsensors, especially cameras. The information about the discrepancies canthen be used for calibrating the sensors. The way of calibrating asensor based on discrepancies between a sensor image and a “real” image(which here is considered to be the image provided from the database) isknown in the art and such not described here any further.

The invention is not limited to the above-described embodiments and manymodifications are possible within the scope of the following claims.Such modifications may, for example, involve using a different source ofenergy beam than the exemplified electron beam such as a laser beam.Other materials than metallic powder may be used, such as thenon-limiting examples of: electrically conductive polymers and powder ofelectrically conductive ceramics.

That which is claimed:
 1. A method for navigation of an aerial vehicle, the method comprising providing a sensor image from an aerial vehicle sensor and repeatedly, until at least one predetermined criterion is reached, performing the steps: setting input data comprising information related to pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle; providing a two-dimensional image from a database based on the input data, where the database comprises three-dimensional geo-referenced information of the environment, comparing the sensor image and the two dimensional image from the database; and using the input data for which the two images correspond best to each other for determining at least one of the following quantities pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle.
 2. The method according to claim 1, where the determined at least one quantity comprises the three-dimensional position of the aerial vehicle.
 3. The method according to claim 2, further comprising the steps of: determining a three-dimensional position of the aerial vehicle based on a global navigation satellite system, GNSS; and comparing the determined three-dimensional position of the aerial vehicle based on the GNSS with the determined three-dimensional position of the aerial vehicle where the input data for which the two images correspond best to each other has been used, so as to determine whether the GNSS is providing reliable data.
 4. The method according to claim 1, where the step of comparing the sensor image and the two dimensional image from the database comprises calculating a similarity measure between the two images.
 5. The method according to claim 4, where the two images which correspond best to each other are the two images which have the highest calculated similarity measure between the two images.
 6. The method according to claim 4, where calculating a similarity measure between the two images comprises calculating a cross-correlation between the two images, preferably a normalised cross-correlation.
 7. The method according to claim 1, where the step of providing a two-dimensional image from a database based on the input data comprises providing the two-dimensional image from the database in such a way that it is projected onto the field of view of the aerial vehicle sensor, where it is assumed that the aerial vehicle has its pitch angle, roll angle, yaw angle and three-dimensional position according to the input data, wherein said projection onto the field of view of the aerial vehicle sensor preferably is performed in such a way that said two-dimensional image from the database will have the same or at least basically the same orientation as said sensor image.
 8. The method according to claim 1, wherein the setting of the input data is updated in each step in such a way as to find the best correspondence between the two images.
 9. The method according to claim 6, wherein a normalised cross-correlation is calculated and the value of the normalised cross-correlation for the two images which correspond best to each other is used for calculating an uncertainty of the least one quantity.
 10. The method according to claim 1, where the predetermined criterion is that the steps are repeated a predetermined number of times and/or that the best correspondence between the two images which has been achieved so far converges.
 11. The method according to claim 1, where an uncertainty in the three-dimensional geo-referenced information of the environment is used to calculate an uncertainty of the at least one quantity.
 12. The method according to claim 1, where sensor images from different aerial vehicle sensors are provided and the method is performed independently for the sensor image of each such aerial vehicle sensor, whereupon the determined at least one quantity is a combination of the determined at least one quantity for each independently performed method.
 13. The method according to claim 12, where the combination of the determined at least one quantity for each independently performed method is based on the reliability and/or accuracy of the sensors from which the sensor images are provided.
 14. The method according to claim 1, where an initial setting of the input data comprises information related to assumed real values for the aerial vehicle, especially information related to assumed real values for the pitch angle, the roll angle, the yaw angle and the three-dimensional position of the aerial vehicle.
 15. The method according to claim 1, where the input data comprises pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle, and where the determined at least one quantity is the corresponding at least one quantity of the input data for which the two images correspond best to each other.
 16. A system for navigation of an aerial vehicle, the system comprising a database containing three-dimensional geo-referenced information of the environment, at least one aerial vehicle sensor providing a sensor image, and a processing unit configured to: receive the sensor image, to set input data comprising information related to pitch angle, roll angle, yaw angle and a three-dimensional position of the aerial vehicle, provide two-dimensional images from the database based on the input data, compare the sensor image with a two-dimensional images from the database, to decide which of the two-dimensional images corresponds best to the sensor image, determine at least one of the following quantities pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle based on the input data for which the best correspondence was achieved between one of the two-dimensional images and the sensor image, and communicate said at least one quantity.
 17. The system according to claim 16, further comprising a steering unit for the aerial vehicle, the steering unit being arranged to receive the communicated said at least one quantity.
 18. The system according to claim 16, where the determined at least one quantity comprises the three-dimensional position of the aerial vehicle.
 19. The system according to claim 16, where the processing unit is arranged to repeatedly perform the processes of setting input data, providing a two-dimensional image, and comparing the two-dimensional image with the sensor image until at least one predetermined criterion is reached.
 20. The system according to claim 16, comprising several aerial vehicle sensors, each providing a sensor image, where the processing unit is further arranged to perform independently for each sensor image said processes of receiving sensor images, setting input data, providing two-dimensional images, comparing images, and determining at least one of the following quantities pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle, and where the processing unit further is arranged to determine a combined at least one quantity based on the corresponding determined at least one quantity for each sensor image.
 21. The system according to claim 16, further comprising means for determining a three-dimensional position of the aerial vehicle based on a global navigation satellite system, GNSS, and wherein the processing unit is arranged to determine at least the three-dimensional position of the aerial vehicle based on the input data for which the best correspondence was achieved between one of the two-dimensional images and the sensor image, and wherein the processing unit further is arranged to compare the determined three-dimensional position of the aerial vehicle based on the GNSS with said determined three-dimensional position of the aerial vehicle based on the input data for which the best correspondence was achieved between one of the two-dimensional images and the sensor image, and wherein the processing unit further is arranged to determine whether the GNSS is providing reliable data based on said comparison of the determined three-dimensional positions.
 22. The system according to claim 16, where the processing unit is further arranged to calculate an uncertainty for the determined at least one quantity based on an uncertainty in the three-dimensional geo-referenced information of the environment.
 23. A non-transitory computer program comprising a program code for navigation of an aerial vehicle, the computer program comprising the step of providing a sensor image from an aerial vehicle sensor and repeatedly, until at least one predetermined criterion is reached, performing the steps: setting input data comprising information related to pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle; providing a two-dimensional image from a database based on the input data, where the database comprises three-dimensional geo-referenced information of the environment; comparing the sensor image and the two dimensional image from the database; and using the input data for which the two images correspond best to each other for determining at least one of the following quantities pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle.
 24. Computer program product comprising a program code stored on a non-transitory computer readable media for navigation of an aerial vehicle, comprising the step of providing a sensor image from an aerial vehicle sensor and repeatedly, until at least one predetermined criterion is reached, performing the steps: setting input data comprising information related to pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle; providing a two-dimensional image from a database based on the input data, where the database comprises three-dimensional geo-referenced information of the environment; comparing the sensor image and the two dimensional image from the database; and using the input data for which the two images correspond best to each other for determining at least one of the following quantities pitch angle, roll angle, yaw angle and three-dimensional position of the aerial vehicle. 